Skip to content

docs: add local decisions blog post and generated images - #56

Merged
elbruno merged 1 commit into
mainfrom
elbruno-onnx-local-models-research
Oct 1, 2026
Merged

elbruno merged 1 commit into
mainfrom
elbruno-onnx-local-models-research

Conversation

@elbruno

@elbruno elbruno commented Sep 30, 2026

Copy link
Copy Markdown
Owner

Adds a technical, code-sample-driven blog post for the v0.22.0 ElBruno.LocalLLMs.Decisions release, ready to publish on elbruno.com.

What's here

File Purpose
docs/blog/blog-local-decisions.md The post
docs/blog/blog-local-decisions-assets.md Companion: titles, tags, image prompts, alt text, fact-check table
images/blog-local-decisions.png Hero image
docs/blog/assets/local-decisions/one-forward-pass.png Supporting figure
docs/blog/assets/local-decisions/calibration-clamp.png Supporting figure

Every number is from a live run

No estimated or invented benchmarks. The companion file records the source for each figure so they can be re-verified:

  • Routing confidences (98.4% / 73.7% / 64.9%), latencies (586 / 595 / 526 ms for 4 batched questions) and token counts — from an actual dotnet run --project src/samples/LocalDecisions.
  • The 86.9% vs 100.0% clamped-bucket table and the fp16 variance deltas — from docs/decisions-guide.md.

Verification done

  • The minimal C# snippet was compiled against the real package in a scratch project — Build succeeded, 0 Error(s) — rather than eyeballed. This confirmed the parameterless LayaOnnxDecisionClient() ctor, result.Probability, and result.CalibrationClamped.
  • The larger snippet is copied from the committed LocalDecisions sample.
  • All 7 relative links resolve from docs/blog/.
  • Images were checked visually; all three are clean with no garbled AI text.

Note on the branch

This branch was previously squash-merged for v0.22.0, so git no longer saw main as an ancestor — a PR from it would have re-proposed all 80 already-merged files. I reset the branch onto origin/main first, so this PR contains exactly the 5 new files.

Tone

Follows the existing blog-bitnet-launch.md / blog-inkling-support.md conventions, and keeps the honest-caveats section: the clamped choice:11+ bucket still reports saturated confidence, so ranking is usable but magnitude is not, and ChoiceOrNull(threshold) will never abstain there.

Docs-only — no code or workflow changes.

Adds a technical, code-sample-driven blog post for the v0.22.0
ElBruno.LocalLLMs.Decisions release, plus a companion assets file
and three generated illustrations.

All figures in the post come from live runs rather than estimates:
routing confidences and latencies from the LocalDecisions sample,
and the calibration-clamp and fp16 variance tables from
docs/decisions-guide.md. The companion file records the source for
each number so they can be re-verified.

The post covers the honest calibration caveats as well as the happy
path: the clamped choice:11+ bucket still reports saturated
confidence, so ranking is usable but magnitude is not.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: c71e4170-a73a-4ac2-8c59-4b80834e7968
@elbruno
elbruno merged commit 6bdc9a4 into main Oct 1, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant